Jean Dezert', Florentin Smarandache’, Albena Tchamova? 


1ONERA, 29 Av. de la Division Leclerc 92320, Chatillon, France 
*Department of Mathematics University of New Mexico Gallup, NM 8730, U.S.A. 


*Institute for Parallel Processing, Bulgarian Academy of Sciences, Sofia, Bulgaria 


On Blackman’s Data 
Association Problem 


Published in: 

Florentin Smarandache & Jean Dezert (Editors) 

Advances and Applications of DSmT for Information Fusion 
(Collected works), Vol. I 

American Research Press, Rehoboth, 2004 

ISBN: 1-931233-82-9 

Chapter XV, pp. 325 - 336 


Abstract: Modern multitarget-multisensor tracking systems involve the develop- 
ment of reliable methods for the data association and the fusion of multiple sensor 
information, and more specifically the partitioning of observations into tracks. This 
chapter discusses and compares the application of Dempster-Shafer Theory (DST) 
and the Dezert-Smarandache Theory (DSmT) methods to the fusion of multiple sen- 
sor attributes for target identification purpose. We focus our attention on the para- 
doxical Blackman’s association problem and propose several approaches to outperform 
Blackman’s solution. We clarify some preconceived ideas about the use of degree of 


conflict between sources as potential criterion for partitioning evidences. 


15.1 Introduction 


he association problem is of major importance in most of modern multitarget-multisensor tracking 
ToS This task is particularly difficult when data are uncertain and are modeled by basic 
belief masses and when sources are conflicting. The solution adopted is usually based on the Dempster- 
Shafer Theory (DST) [9] because it provides an elegant theoretical way to combine uncertain information. 


This chapter is based on a paper [4] presented during the International Conference on Information Fusion, Fusion 2003, 


Cairns, Australia, in July 2003 and is reproduced here with permission of the International Society of Information Fusion. 
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However Dempster’s rule of combination can give rise to some paradox/anomaly and can fail to provide 
the correct solution for some specific association problems. This has been already pointed out by Samuel 
Blackman in [2]. Therefore more study in this area is required and we propose here a new analysis 
of Blackman’s association problem (BAP). We present in the sequel the original BAP and remind the 
classical attempts to solve it based on DST (including Blackman’s method). In the second part of the 
chapter we propose and compare new approaches based on the DSmT with the free DSm model. The 
last part of the chapter provides a comparison of the performances of all the proposed approaches from 


Monte-Carlo simulation results. 


15.2 Blackman’s Data Association Problem 


15.2.1 Association Problem no. 1 


Let’s recall now the original Blackman’s association problem [2]. Consider only two target attribute 
types corresponding to the very simple frame of discernment © = {61,62} and the association/assignment 
problem for a single attribute observation Z and two tracks (Tı and T2). Assume now the following two 


predicted basic belief assignments (bba) for attributes of the two tracks: 
mr, (01) =0.5 mr,(02)=0.5 mr, (01; U 02) =0 
mr,(61) =0.1 mr (02) =0.1 mrp, (01 U02) = 0.8 
We now assume to receive the new following bba drawn from attribute observation Z of the system 
mz(61)=0.5 mz(62)=0.5 mz(0, U 62) =0 


The problem is to develop a general method to find the correct assignment of the attribute measure mz/(.) 
with the predicted one mr,(.), i = 1,2. Since mz(.) matches perfectly with mz, (.) whereas mz(.) does 
not match with mz, (.), the optimal solution is obviously given by the assignment (mz(.) > mz, (.)). The 
problem is to find an unique general and reliable method for solving this specific problem and for solving 


all the other possible association problems as well. 


15.2.2 Association Problem no. 2 


To compare several potential issues, we propose to modify the previous problem into a second one by 


keeping the same predicted bba m7, (.) and m7,(.) but by considering now the following bba mz(.) 
mz(@1) = 0.1 mz (02) =0.1 mz (1 U 02) = 0.8 


Since mz(.) matches perfectly with mz, (.), the correct solution is now directly given by (mz(.) > m7,(.)). 


The sequel of this chapter in devoted to the presentation of some attempts for solving the BAP, not only 
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for these two specific problems 1 and 2, but for the more general problem where the bba mz(.) does not 


match perfectly with one of the predicted bba mr,, i = 1 or i = 2 due to observation noises. 


15.3 Attempts for solutions 


We examine now several approaches which have already been (or could be) envisaged to solve the general 


association problem. 


15.3.1 The simplest approach 


The simplest idea for solving BAP, surprisingly not reported by Blackman in [2] is to use a classical 
minimum distance criterion directly between the predictions my, and the observation mz. The classical 
Lt (city-block) or L? (Euclidean) distances are typically used. Such simple criterion obviously provides 
the correct association in most of cases involving perfect (noise-free) observations mz(.). But there exists 
numerical cases for which the optimal decision cannot be found at all, like in the following numerical 
example: 


MT, (81) = 0.4 MT, (02) = 0.4 MT, (0i U 02) = 0.2 
MNT (81) = 0.2 MNT (02) = 0.2 MT (0i U 02) = 0.6 
mz (61) = 0.3 mz (62) = 0.3 mz (0, U 62) = 0.4 


From these bba, one gets dz1(T1, Z) = dr: (To, Z) = 0.4 (or dzp2(T, Z) = dz2(Th, Z) ~% 0.24) and no 
decision can be drawn for sure, although the minimum conflict approach (detailed in next section) will 
give us instead the following solution (Z > T>). It is not obvious in such cases to justify this method 
with respect to some other ones. What is more important in practice [2], is not only the association 
solution itself but also the attribute likelihood function P(Z|T;) = P(Z e T;). As we know many 
likelihood functions (exponential, hyper-exponential, Chi-square, Weibull pdf, etc) could be build from 
drı(T;, Z) (or dp2(T;,Z) measures but we do not know in general which one corresponds to the real 


attribute likelihood function. 


15.3.2 The minimum conflict approach 


The first idea suggested by Blackman for solving the association problem was to apply Dempster’s rule 
of combination [9] mz,z(.) = [mr, 6 mz](.) defined by mr,z(0) = 0 and for any C £ 9 and C C ©, 


1 


ee a oe 


XO mr,(A)mz(B) 


ANB=C 
and choose the solution corresponding to the minimum of conflict kr,z. The sum in previous formula is 


over all A,B C © such that AN B = C. The degree of conflict kr,z between mr, and mz is given by 
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ang- MT: (A)mz(B) #0. Thus, an intuitive choice for the attribute likelihood function is P(Z|T;) = 
1—kr,z. If we now apply Dempster’s rule for the problem 1, we get the same result for both assignments, 
ie. mr,z(.) = mrz(.) with mr;z(01) = mr;z(02) = 0.5 for i = 1,2 and mrz(61 U 62) = 0, and more 
surprisingly, the correct assignment (Z +> Tı) is not given by the minimum of conflict between sources 
since one has actually (kr, z = 0.5) > (krz = 0.1). Thus, it is impossible to get the correct solution for 
this first BAP from the minimum conflict criterion as we firstly expected intuitively. This same criterion 
provides us however the correct solution for problem 2, since one has now (kr,z = 0.02) < (kr,z = 0.1). 
The combined bba for problem 2 are given by mr, z(01) = mr, z(02) = 0.5 and m7,z(61) = m7,z(02) = 


0.17347, mr,z(01 U 62) = 0.65306. 


15.3.3 Blackman’s approach 


To solve this apparent anomaly, Samuel Blackman has then proposed in [2] to use a relative, rather than 


an absolute, attribute likelihood function as follows 
L(Z | T;) ê (1 — kr,z)/(1 — RZ) 


where k> is the minimum conflict factor that could occur for either the observation Z or the track T; 
in the case of perfect assignment (when mz(.) and m7,(.) coincide). By adopting this relative likelihood 


function, one gets now for problem 1 


Using this second Blackman’s approach, there is now a larger likelihood associated with the first 
assignment (hence the right assignment solution for problem 1 can be obtained now based on the max 
likelihood criterion) but the difference between the two likelihood values is very small. As reported by 
S. Blackman in [2], more study in this area is required and we examine now some other approaches. It 
is also interesting to note that this same approach fails to solve the problem 2 since the corresponding 


likelihood functions for problem 2 become now 


which means that the maximum likelihood solution gives now the incorrect assignment (mz(.) © mr, (.)) 


for problem 2 as well. 


15.3.4 Tchamova’s approach 


Following the idea of section{[5.3.1] Albena Tchamova has recently proposed in [3] to use rather the L! 
(city-block) distance dı (T;, T;Z) or L? (Euclidean) distance d2(T;,T;Z) between the predicted bba my, (.) 
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and the updated/combined bba m7, z(.) to measure the closeness of assignments with 
dy.(T;,T;Z) = X. | mr,(A) — mr,z(A) | 
AeE2° 
1/2 


dre (Ti, T42) = [> [mr,(A) — mr,z(A)}’] 
AE2° 


The decision criterion here is again to choose the solution which yields the minimum distance. This 
idea is justified by the analogy with the steady-state Kalman filter (KF) behavior because if z(k + 1) 
and 2(k + 1|k) correspond to measurement and predicted measurement for time k + 1, then the well- 
known KF updating state equation [I] is given by (assuming here that dynamic matrix is identity) 
&(k+1k+1) = ĉ(k + 1k) + K(z(k +1) — 2(K + 1]k)). The steady-state is reached when z(k + 1) 
coincides with predicted measurement 2(k + 1|k) and therefore when ĉ(k + 1|k +1) = ĉ(k + 1|k). In 
our context, m7,(.) plays the role of predicted state and mz, z(.) the role of updated state. Therefore it 
a priori makes sense that correct assignment should be obtained when mr, z(.) tends towards mr, (.) for 
some closeness/distance criterion. Monte Carlo simulation results will prove however that this approach 


is also not as good as we can expect. 


It is interesting to note that Tchamova’s approach succeeds to provide the correct solution for problem 
1 with both distances criterions since (dz1(T,7,Z) = 0) < (dpi (T2, T2Z) ~ 1.60) and (dz2(T%1,T1Z) = 
0) < (dz2(To,T2Z) ~ 0.98), but provides the wrong solution for problem 2 since we will get both 
(dpi (T2, T2Z) ~ 0.29) > (dr: (T1,T1,Z) = 0) and (dr: (T2, T22) ~ 0.18) > dr: (T1, Tı Z) = 0). 


15.3.5 The entropy approaches 


We examine here the results drawn from several entropy-like measures approaches. Our idea is now to use 
as decision criterion the minimum of the following entropy-like measures (expressed in nats - i.e. natural 


number basis with convention 0 log(0) = 0): 


e Extended entropy-like measure: 


Heae(m) # — J m(A) log(m(A)) 
AE29 
e Generalized entropy-like measure [5] [B]: 
Hgen(m) = — X m(A)log(m(A)/JA]) 


AE29 


e Pignistic entropy: 


Hiep (m) È — 5 P{0;} log(P{0:}) 


0iEO 
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where the pignistic(betting) probabilities P(6;) are obtained by 
vie, P{i}= Y p”) 
BCO|O;EB 

It can be easily verified that the minimum entropy criterion (based on Heat, Hgen or Hvetp) computed 
from combined bba mriz(.) or mrzz(.) are actually unable to provide us correct solution for problem 
1 because of indiscernibility of mrız(.) with respect to mr2z(.). For problem 1, we get Hea:(mriz) = 
Hert(Mmr2z) = 0.69315 and exactly same numerical results for Hen and Hpetp because no uncertainty is 
involved in the updated bba for this particular case. If we now examine the numerical results obtained 
for problem 2, we can see that minimum entropy criteria is also unable to provide the correct solution 
based on Hest, Hgen or Hyetp criterions since one has Hest(mr2z) = 0.88601 > Hert(mriz) = 0.69315, 


Hgen(mrez) = 1.3387 > Hgen(mriz) = 0.69315 and Apere(mriz) = Ayere(mrez) = 0.69315. 


These first results indicate that approaches based on absolute entropy-like measures appear to be 
useless for solving BAP since there is actually no reason which justifies that the correct assignment 
corresponds to the absolute minimum entropy-like measure just because mz can stem from the least 
informational source. The association solution itself is actually independent of the informational content 


of each source. 


An other attempt is to use rather the minimum of variation of entropy as decision criterion. Thus, 
the following min{Aj(.), A2(.)} criterions are examined; where variations A;(.) for i = 1,2 are defined as 


the 
e variation of extended entropy: 
Ai (Hest) = Hext(M7,z) oa Heat(mr,) 
e variation of generalized entropy: 
Ai(Agen) = Hgen(mr,z) — Hgen(mr,) 
e variation of pignistic entropy: 
A; (Hvete) = Hiep (mr, z) — Herp (Mr, ) 


Only the 2nd criterion, i.e. min(A;(Hger)) provides actually the correct solution for problem 1 and 


none of these criterions gives correct solution for problem 2. 


The last idea is then to use the minimum of relative variations of pignistic probabilities of 0; and 62 


given by the minimum on i of 


Ai(P) 25> mae ree (6;)| 


j=l 
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where Pr,z(.) and Pr,(.) are respectively the pignistic transformations of mz,z(.) and mz,(.). Unfortu- 
nately, this criterion is unable to provide the solution for problems 1 and 2 because one has here in both 


problems A (P) = A2(P) = 0. 


15.3.6 Schubert’s approach 


We examine now the possibility of using a Dempster-Shafer clustering method based on metaconflict 
function (MC-DSC) proposed in Johan Schubert’s research works [{6][8] for solving the associations prob- 
lems 1 and 2. A DSC method is a method of clustering uncertain data using the conflict in Dempster’s 
rule as a distance measure [7]. The basic idea is to separate/partition evidences by their conflict rather 
than by their proposition’s event parts. Due to space limitation, we will just summarize here the principle 


of the classical MC- DSC method. 


Assume a given set of evidences (bba) E(k) = {mz,(.),i = 1,...,n} is available at a given index 
(space or time or whatever) k and suppose that a given set E(k + 1) = {mz,(.),j = 1,...,m} of new 
bba is then available for index k +1. The complete set of evidences representing all available information 
at index k + 1 is x = E(k) U E(k +1) ê {e1,...,eq} = {mz,(.),i = 1,...,n,mz,(.),j = 1,..., m} with 
q=n+m. The problem we are faced now is to find the optimal partition/assignment of x in disjoint 
subsets Xp in order to combine informations within each Xp in a coherent and efficient way. The idea is 
to combine, in a first step, the set of bba belonging to the same subsets yp into a new bba m,(.) having 
a corresponding conflict factor kp. The conflict factors kp are then used, in a second step, at a metalevel 
of evidence associated with the new frame of discernment © = {AdP,—Adp} where AdP is short for 
adequate partition. From each subset yp, p = 1,...P of the partition under investigation, a new bba is 
defined as: 

ity, (oAdP) kp and m,,(@)=1—4, 


The combination of all these metalevel bba m,,,(.) by Dempster’s rule yields a global bba 
m(.) = my, (.) ©- B Myp (-) 


with a corresponding metaconflict factor denoted Mcf(x1,...,x Pp) = kı,... p. It can be shown [6] that the 
metaconflict factor can be easily calculated directly from conflict factors kp by the following metaconflict 


function (MCF) 
P 


Mcf(xn--xe)=1- [[C- kp) (15.1) 


p=1 
By minimizing the metaconflict function (i.e. by browsing all potential assignments), we intuitively 
expect to find the optimal/correct partition which will hopefully solve our association problem. Let’s go 


back now to our very simple association problems 1 and 2 and examine the results obtained from the 
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MC-DSC method. 


The information available in association problems is denoted x = {mr,(.),mr,(.),mz(.)}. We now 
examine all possible partitions of x and the corresponding metaconflict factors and decision (based on 


minimum metaconflict function criterion) as follows: 
e Analysis for problem 1: 


— the (correct) partition xı = {m7,(.),mz(.)} and x2 = {mr,(.)} yields through Dempter’s rule 
the conflict factors kı £ kr,z = 0.5 for subset xı and kg = 0 for subset x2 since there is 
no combination at all (and therefore no conflict) in x2. According to (5.1), the value of the 


metaconflict is equal to 
Mcf; =1- (1 = ky)(1 = k2) =0.5 = ky 


— the (wrong) partition xı = {mr,(.)} and x2 = {mn (.),mz(.)} yields the conflict factors 


kı = 0 for subset xı and kə = 0.1 for subset x2. The value of the metaconflict is now equal to 
Mcfg = 1 — (1 — kı )(1 — k2) = 0.1 = k2 


— since Mcf, > Mcfo, the minimum of the metaconflict function provides the wrong assignment 


and the MC-DSC approach fails to generate the solution for the problem 1. 
e Analysis for problem 2: 


— the (wrong) partition xı = {mr7,(.),mz(.)} and x2 = {m7,(.)} yields through Dempter’s rule 
the conflict factors kj £ krz = 0.1 for subset xı and kg = 0 for subset v2 since there is 
no combination at all (and therefore no conflict) in x2. According to ([5.1), the value of the 


metaconflict is equal to 
Mcfı = 1 — (1 — kı)(1 — k2) = 0.1 = kı 


— the (correct) partition x; = {mr,(.)} and x2 = {mn (.), mz(.)} yields the conflict factors 
kı = 0 for subset xı and kz = 0.02 for subset x2. The value of the metaconflict is now equal 
to 


Mcf = 1 — (1 — kı )(1 — k2) = 0.02 = k2 


— since Mcfə < Mcf,, the minimum of the metaconflict function provides in this case the correct 


solution for the problem 2. 


From these very simple examples, it is interesting to note that Schubert’s approach is actually exactly 


equivalent (in these cases) to the min-conflict approach detailed in section[[5.3.2Jand thus will not provide 
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unfortunately better results. It is also possible to show that Schubert’s approach also fails if one considers 
jointly the two observed bba mz, (.) and mz, (.) corresponding to problems 1 and 2 with mz, (.) and m7, (.). 
If one applies the principle of minimum metaconflict function, one will take the wrong decision since the 
wrong partition {(Z1, T2), (Z2, Tı)} will be declared. This result is in contradiction with our intuitive 
expectation for the true opposite partition { (Z1, T1), (Z2, T2)} taking into account the coincidence of the 


respective belief functions. 


15.4 DSmT approaches for BAP 


As within DST, several approaches can be attempted to try to solve Blackman’s Association prob- 
lems (BAP). The first attempts are based on the minimum on i of new extended entropy-like measures 
H* 


tet(Mr7,z) or on the minimum H‘,,~(P*). Both approaches actually fail for the same reason as for the 


DST-based minimum entropy criterions. 


The second attempt is based on the minimum of variation of the new entropy-like measures as criterion 


for the choice of the decision with the new extended entropy-like measure: 
Ai(Heet) = Hirmer, z) — Hén (mr,) 
or the new generalized pignistic entropy: 
Ai(Hieep) = Hiep (P*{-|mr,z}) — Hiep (P*{lmr,}) 


The min. of A;(Hx,,) gives us the wrong solution for problem 1 since Ai (H%,,) = 0.34657 and 
A2(Hž,4) = 0.30988 while min. of A;(Hġ+p) give us the correct solution since Aı(Hġ+p) = —0.3040 
and A2(Hġp) = —0.0960. Unfortunately, both the A;(HZ,,) and A;(H}.,p) criterions fail to pro- 


vide the correct solution for problem 2 since one gets Ai(H%,,) = 0.25577 < Ao(Hx.,) = 0.3273 and 
Aı (Hip) = —0.0396 < Ac(Hk,p) = —0.00823. 


The third proposed approach is to use the criterion of the minimum of relative variations of pignistic 
probabilities of 0} and 62 given by the minimum on 7 of 
NESI Piz ; Pi (6;)| 
jai TiVi 
This third approach fails to find the correct solution for problem 1 (since A; (P*) = 0.333 > A2(P*) = 
0.268) but succeeds to get the correct solution for problem 2 (since Ag(P*) = 0.053 < A1 (P*) = 0.066). 


334 CHAPTER 15. ON BLACKMAN’S DATA ASSOCIATION PROBLEM 


The last proposed approach is based on relative variations of pignistic probabilities conditioned by 
the correct assignment. The criteria is defined as the minimum of 
5 (pr) & APZ) ~ ACP = T) 
Ai(P*|Z = Ti) 
where A;(P*|Z = T;) is obtained as for A;(P*) but by forcing Z = T; or equivalently mz(.) = mr,(.) for 
the derivation of pignistic probabilities Pz, 7(0;). This last criterion yields the correct solution for problem 


1 (since 5; (P*) = |0.333 — 0.333|/0.333 = 0 < 69(P*) = |0.268 — 0.053|/0.053 ~ 4) and simultaneously 
for problem 2 (since 62(P*) = |0.053 — 0.053|/0.053 = 0 < 6,(P*) = |0.066 — 0.333] /0.333 ~ 0.8). 


15.5 Monte-Carlo simulations 


As shown on the two previous BAP, it is difficult to find a general method for solving both these partic- 
ular (noise-free mz) BAP and all general problems involving noisy attribute bba mz(.). The proposed 
methods have been examined only for the original BAP and no general conclusion can be drawn from our 
previous analysis about the most efficient approach. The evaluation of the global performances /efficiency 
of previous approaches can however be estimated quite easily through Monte-Carlo simulations. Our 
Monte-carlo simulations are based on 50.000 independent runs and have been done both for the noise- 
free case (where mz(.) matches perfectly with either mr, (.) or m7,(.)) and for two noisy cases (where 
mz(.) doesn’t match perfectly one of the predicted bba). Two noise levels (low and medium) have been 
tested for the noisy cases. A basic run consists in generating randomly the two predicted bba mr, (.) and 
mr, (.) and an observed bba mz(.) according to a random assignment mz(.) @ mr, (.) or mz(.) < mz, (.). 
Then we evaluate the percentage of right assignments for all chosen association criterions described in 
this chapter. The introduction of noise on perfect (noise-free) observation mz(.) has been obtained by 
the following procedure (with notation A, £ 01, A2 £ 02 and Ag £ 6; U 62): my” (Ai) = aymz(A;)/K 


noisy 


where K is a normalization constant such as DS mz 7 (Ai) = 1 and weighting coefficients a; € [0; 1] 





are given by a; = 1/3 «e; such that a a; =1. 


The table 1 shows the Monte-Carlo results obtained with all investigated criterions for the following 
3 cases: noise-free (NF), low noise (LN) and medium noise (MN) related to the observed bba mz(.). 
The two first rows of the table correspond to simplest approach. The next twelve rows correspond to 


DST-based approaches. 
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Assoc. Criterion 
Min dz: (T;, Z) 
Min dz2(T;, Z) 
Min kr, z 

Min L(Z|T;) 

Min dz: (T;,T;Z) 
Min dz2(T;,T;Z) 
Min Hext(mr,z) 
Min Hyen(mr,z) 
Min Apyerp(mr7,z) 
Min A; (Hezxt) 
Min A;(Hgen) 
Min A;(Abetp) 
Min A; (P) 





Min Mcf; 


Table 1 : % of success of association methods 


NF 
100 
100 
70.01 
70.09 
57.10 
56.40 
61.39 
58.37 
61.35 
57.66 
57.40 
71.04 
69.25 
70.1 


LN 
97.98 
97.90 
69.43 
69.87 
57.41 
56.80 
61.68 
58.79 
61.32 
56.97 
56.80 
69.15 
68.99 
69.43 


MN 
92.14 
92.03 
68.77 
67.86 
56.30 
55.75 
60.85 
57.95 
60.34 
55.90 
55.72 
66.48 
67.35 
68.77 
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The table 2 shows the Monte-Carlo results obtained for the 3 cases: noise-free (NF), low noise (LN) 


and medium noise (MN) related to the observed bba mz(.) with the DSmT-based approaches. 


Assoc. Criterion 
Min H2,,(mz,z) 
Min Hf.,p(P*) 
Min A,(Hz,1) 
Min A;(Hžap) 
Min A;(P*) 
Min 6;(P*) 





Table 2 : % of success of DSmT-based methods 


15.6 Conclusion 


A new examination of Blackman’s association problem has been presented in this chapter. 


NF 


61.91 
42.31 
67.99 
42.08 
76.13 

100 


LN 


61.92 
42.37 
67.09 
42.11 

75.3 
90.02 


MN 


60.79 
42.96 
65.72 
42.21 
72.80 
81.31 


Several 


methods have been proposed and compared through Monte Carlo simulations. Our results indicate that 


the commonly used min-conflict method doesn’t provide the best performance in general (specially w.r.t. 


the simplest distance approach). Thus the metaconflict approach, equivalent here to min-conflict, does 


not allow to get the optimal efficiency. Blackman’s approach and min-conflict give same performances. 
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All entropy-based methods are less efficient than the min-conflict approach. More interesting, from the 
results based on the generalized pignistic entropy approach, the entropy-based methods seem actually 
not appropriate for solving BAP since there is no fundamental reason to justify them. The min-distance 
approach of Tchamova is the least efficient method among all methods when abandoning entropy-based 
methods. Monte Carlo simulations have shown that only methods based on the relative variations of 
generalized pignistic probabilities build from the DSmT (and the free DSm model) outperform all methods 
examined in this work but the simplest one. Analysis based on the DSmT and hybrid DSm rule of 


combination are under investigation. 
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